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@ In motion compensated interpolation of TV-pic- 
tures It is usual to divide the picture into a plurality 
of blocks, a motion vector being determined for each 
block. This division into blocks has the disadvantage, 
that sometimes block boundaries become visible 
(dirty window effect). The invention generates a con- 
tinuous vector field from the blocked vector field with 
the aid of a median filter which calculates for each 
subblock (HI) from a number of subblocks (H1.-.H4) 
into which each block (H) is divided, a motion vector 
based on the motion vectors of the original block (H) 
to which the subblock belongs, and of the original 
blocks (E. G) adjacent to the subblock <H1) con- 
cerned. 
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The tnvention relates to a motion vector pro- 
cess.ng (including storage or transmission) device 
for processing motion vectors corresponding to pic- 
tures being subdivided into a number of blocks 
For each of these blocks a motion vector is avail- 
able for efficient storage, transmission or process- 
ing (e.g. scan rate conversion) etc. 

The availability of only one vector per block of 
pixels can give rise to the visibility of these blocks 
.n a picture obtained by such motion compensated 
processing. As a possible solution to reduce the 
visibi^ty of the blocks, the vector field could be 
postfiltered. but this has the disadvantage that new 
vectors are generated, the quality of which was 
never checked. US-A 4,703.350 describes such a 
post filter, which uses a raised cosine function or a 
linear interpolation filter to obtain motion vectors for 
each pixel. 

When the estimator uses a matching criterion 
It IS possible that the average of two vectors each 
yielding a good match, results in a vector that 
gives a very bad match. One could for instance 
think of a periodic structure on which several 
matches are possible, but on which the average 
vector may yield a bad match. 

It is (inter alia) an object of the present inven- 
tion to provide a post operation on the vector field 
which - as does the linear post filter - yields a 
smooth vector field, but which does not generate 
unchecked motion vector components. 

For this purpose, a first aspect of the invention 
provides a motion vector processing device for 
processing motion vectors corresponding to pic- 
^'"H subdivided into a plurality of blocks, for 
each block a motion vector being available, com- 
pnsing: 

means for providing x and y motion vector 
components of a given block and of blocks adja- 
cent to said given block; 

means coupled to receive x and y motion 
vector components corresponding to said given 
block and each time two x and two y motion vector 
cornponents corresponding to each time two of 
said adjacent blocks, for supplying for each sub- 
^ Kr,"^' °' s^bblocks together forming 
said given block selected ones of these x and y 
motion vector components; and 

means for creating for each subblock x and v 
mobon vector components based on said selected 
motion vector components. 

According to this aspect of the invention the 
output motion vector components which corre- 
spond to the subblocks into which each block has 
been divided, are selected from the input motion 
vector components which have been estimated for 
the onginal. larger blocks. Therefore, no new un- 
checked motion vector components are generated 
In an embodiment of the invention, said creat- 



ing means comprise: 

means coupled to receive said selected motion 
vector components for checking whether selected x 
and y motion vector components supplied for a 
5 same subblock correspond to a same block- and 

means for delivering said motion vector cor- 
responding to said given block if said selected x 
and y components supplied for the same subblock 
do not correspond to the same block, and for 
w delivering said selected x and y motion vector 
components othen<vise. This ensures not only that 
the output vector components correspond to se- 
lected input vector components, but also that the 
output vectors are not composed from components 
/s which do not belong to each other. 

A very smooth vector field and. consequently 
very good motion compensated pictures appeared 
to be Obtainable when using an embodiment 
wherein said supplying means include means for 
20 obtaining x and y median filtered vector compo- 
nents from the x and y mofion vector components 
corresponding to the given block and from the two 
X and two y motion vector components correspond- 
ing to the two adjacent blocks. 
25 A second aspect of the invention provides a 

mofton vector processing device for processing 
motion vectors corresponding to pictures being di- 
vided into a plurality of blocks, for each block a 
motion vector being available, comprising- 
30 means for providing motion vectors con-e- 

sponding to a given block and to blocks adjacent to . 
said given block; 

means for creafing for each subblock of a 
number of subblocks together forming said given 
OS block, a motion vector from the motion vectors 
corresponding to the given block and to at least 
one of said adjacent blocks: 

means for checking whether said created mo- 

^ tors an?'^ '° ^^'"^ 

means for selecting for each subblock said 
motion vector corresponding to said given block if 
the mofion vector created for that subblock does 
not belong to said provided mofion vectors, and for 
"5 selecting the created motion vector itself otherwise 
Also this aspect ensures that only reliable motion 
vectors are obtained. 

A simple and reliable manner to obtain only 
checked motion vector components is employed in 
60 an embodiment wherein said creafing means in- 
clude means for supplying selected ones of x and 
y mofion vector components corresponding to said 
given block and to said at least one adjacent block 
If desired, the obtained subblocks may be fur- 
ss ther subdivided. If the subdividing operation is re- 
peated often enough, mofion vectors are obtained 
for each pixel. 

These and other (more detailed) aspects of the 
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invention will be described and elucidated with 
reference to the drawings and examples. 
In the drawings: 

Fig. 1 gives an example of a vector field; 

Fig. 2 shows a vector field in which one block is 

divided into four subblocks; 

Rg. 3 shows a two-step block erosion; 

Rg. 4 shows a first embodiment of a one step 

block eroder; and 

Rg. 5 shows a second embodiment of a one- 
step block eroder. 
Rg. 1 gives an example of a vector field. For 
each block A..0 of pixels only one vector is avail- 
able. As is shown for a given block H in Rg. 2. in 
an embodiment of the present invention, each 
block Is divided into four subblocks. The x and y 
vector components for a subblock become the 
respective median values of: 

1. the X and y vector components of the given 
block that contains the subblock: and 

2. the X and y vector components of two neigh- 
boring blocks which are adjacent to the sub- 
block. 

The X and y vector compionents are processed 
separately. Because of this separate operation, a 
new vector, which belongs neither to the given 
block nor to either of its two neighboring blocks 
can be created. That is why. according to a pre- 
ferred emtXKliment of the invention, after the 
median operation it is checked whether the new 
vector is equal to one of the three input vectors. If 
not. the vector of the given block that contains the 
subblock is taken instead of the new vector; if yes, 
the new vector itself is used as the vector cor- 
responding to the subblock for subsequent motion 
compensated processing. 

So for the subblocks H1. H2. H3. H4, the 
vector value is calculated as follows, using symbols 
derived from programming languages. 
Hjc indicates the x component of the motion vector 
of block H. 

< > means **is not equal to". 

HI jc = median (H.x. Ejc. Gjc) 

H1 .y = median (H.y. E.y, G,y) 

If (H1 < > H) and (HI <> E) and (HI <> G) then 

H1 = H 

H2jc = median (H.x. G.x, K.x) 

H2.y = median (H.y, G.y, K.y) 

If (H2 < > H) and (H2 < > G) and (H2 < > K) then 

H2 = H 

H3jc = median (H.x. Ijc. K.x) 

H3.y = median (H.y, l.y, K.y) 

If (H3 < > H) and (H3 < > I) and (H3 < > K) then 

H3 = H 

H4.X = median (H.x, l.x, E.x) 
H4.y = median (H.y. l.y*. E.y) 

If (H4 < > H) and (H4 < > I) and (H4 < > E) then 
H4 = H 



This process can - if necessary e.g. for large 
initial block sizes - be repeated for the subblocks. 
Each subblock is then subdivided into four parts. 
Subblock HI for example, is divided into the parts 

5 HI a. Hid. The resulting vector becomes the 
median value of the vectors from the subblock and 
its neigboring blocks- 

Again, according to said preferred embodi- 
ment, it is checked that only existing vectors result 

70 from the process. Rg. 3 illustrates the process. The 
vector for part H1a now becomes: 
H1a.x = median (H1.x. E2.x, G4.x) 
H1a.y = median (H1.y, E2.y. G4.y) 
If (Hia < > HI) and (Hia < > E2) and (Hia < > 

15 G4) then Hia = HI 

Fig. 4 shows a first embodiment of a one-step 
block eroder according to the invention. The exam- 
ple shown calculates 4 motion vectors for each one 
of the subblocks H1..H4 of block H. The implemen- 

20 tation shown deals only with the x components of 
the vectors; the y components are processed simi- 
lariy. 

As is apparent from Rg. 2, for subblock HI, 
blocks E, G and H are relevant: for subblock H2. 

25 blocks G. K and H are relevant; for subblock H3. 
blocks K, I and H are relevant; and for subblock 
H4. blocks I. E and H are relevant. Under the 
control of a subblock pointer sb. multiplexers 41 x 
and 43x select the relevant motion vector compo- 

30 nents of the relevant neighboring blocks for ap- 
plication to the subsequent median filtering opera- 
tion. Comparators 45x. 47x and 49x and look-up- 
table (LUT) 51 x determine the median of the vector 
components 1 and 2 outputted by multiplexers 41 x 

35 and 43x, respectively, and of the vector component 
3 of block H itself. For a more detailed description 
of median determination, reference is made to US- 
A 4,740.820 (PHA 11.613), incorporated herein by 
reference. Controlled by LUT 51 x, multiplexer 53x 

40 selects the median of vector components 1, 2 and 
3 for outputting as the x-component of the sub- 
block concerned. 

Alternatively, multiplexer 53x could select from 
the input vector components Ejc. G.x, K.x, 1.x and 

45 Hjc. In that case, the subblock pointer sb should be 
applied to LUT 51x as well. 

Rg. 5 shows a second embodiment of a one- 
step block eroder, in which both x and y compo- 
nents are dealt with by LUT 5r to ensure that the 

50 output X and y vector components originate from 
the same input vector. In the programming lan- 
guage statements mentioned above, this checking 
operation corresponds to each third statement. 
When the motion vector estimator itself already 

55 yields a rather smooth vector field, as e.g. the 
estimator described in Applicants' article "New al- 
gorithm for motion estimation" presented at the 
Third International Workshop on HDTV, Torino, 
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1989. this checking operation can be left out, since 
simulations showed that the checking operation 
changed the decision for only a small percentage 
of blocks, and leaving it out introduced no visible 
artifacts. s 

The difference between Rgs. 4 and 5 is mainly 
that separate LUTs 51 x (shown) and 51 y (not 
shown) are replaced by a single, more complex, 
LUT 51* which in addition has to perform the ab- 
ovementioned checking operation. In Rg. 5 one ;o 
dual 3-state multiplexer 53' is shown; however, two 
multiplexers 53x (as shown in Rg, 4) and 53y both 
controlled by LUT 5V are also possible. As already 
mentioned with reference to Rg. 4. if in an alter- 
native embodiment the subblock pointer would be 75 
applied to LUT 51*. one dual 5-state multiplexer or 
two separate 5-state multiplexers would also be 
possible. 

Claims 20 

1. Motion vector processing device for process- 
ing motion vectors corresponding to pictures 
being subdivided into a plurality of blocks, for 
each block a motion vector being available, 2S 
comprising: 

means for providing x and y motion vector 
components of a given block and of blocks 
adjacent to said given block; 

means coupled to receive x and y motion 30 
vector components corresponding to said giv- 
en block and each time two x and two y 
motion vector components corresponding to 
each time two of said adjacent blocks, for 
supplying for each subblock of a number of as 
subblocks together forming said given block 
selected ones of these x and y motion vector 
components; and 

means for creating for each subblock x 
and y motion vector components based on 40 
said selected motion vector components. 

2. Motion vector processing device as claimed in 
Claim 1, wherein said creating means com- 
prise: 45 

means coupled to receive said selected 
motion vector components for checking wheth- 
er selected x and y motion vector components 
supplied for a same subblock correspond to a 
same block; and so 

means for delivering said motion vector 
corresponding to said given block if said se- 
lected x and y components supplied for the 
same subblock do not correspond to the same 
block, and for delivering said selected x and y 55 
motion vector components otherwise. 



Claim .1 or 2. wherein said supplying means 
include means for obtaining x and y median 
filtered vector components from the x and y 
motion vector components corresponding to 
the given block and from the two x and two y 
motion vector components corresponding to 
the two adjacent blocks. 

Motion vector processing device for process- 
ing motion vectors corresponding to pictures 
being divided into a plurality of blocks, for 
each block a motion vector being available, 
comprising: 

means for providing motion vectors cor- 
responding to a given block and to blocks 
adjacent to said given block; 

means for creating for each subblock of a 
number of subblocks together forming said 
given block, a motion vector from the motion 
vectors corresponding to the given block and 
to at least one of said adjacent blocks; 

means for checking whether said created 
motion vectors belong to said provided motion 
vectors; and 

means for selecting for each subblock said 
motion vector corresponding to said given 
block if the motion vector created for that 
subblock does not belong to said provided 
motion vectors, and for selecting the created 
motion vector itself otherwise. 

Motion vector processing device as claimed in 
Claim 4, wherein said creating means include 
means for supplying selected ones of x and y 
motion vector components corresponding to 
said given block and to said at least one adja- 
cent block. 

Motion vector processing device as claimed in 
Claim 4. wherein said creating means include 
means for obtaining x and y median filtered 
motion vector components from x and y mo- 
tion vector components corresponding to said 
given block and from two x and two y motion 
vector components corresponding to two 
blocks adjacent to the subblock for which the 
motion vector is created. 



3. Motion vector processing device as claimed in 
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